The dynamics of critical Kauffman networks under asynchronous stochastic update 
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We show that the mean number of attractors in a critical Boolean network under asynchronous 
stochastic update grows like a power law and that the mean size of the attractors increases as a 
stretched exponential with the system size. This is in strong contrast to the synchronous case, where 
the number of attractors grows faster than any power law. 
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Random Boolean networks were introduced in 1969 by 
Kauffman as a simple model for complex systems 

consisting of units that interact via directed links. They 
are used to model social and economic networks 0, Q^, 
neural networks, and gene or protein webs 0|. 

A random Boolean network (RBN) is a directed graph 
with TV nodes each of which takes a Boolean value Ui G 
{0, 1}. The number k of incoming edges is the same for 
all nodes, and the starting points of the edges are cho- 
sen at random. Usually these models are updated syn- 
chronously, ai{t + I) = Ci{adi^i{t),. . . ,adi^^{t)), where 
the Boolean coupling function Ci of node i is chosen at 
random among a given set of functions and dij denotes 
the j-th input of node i. The configuration of the sys- 
tem (T = {(Ti, . . . , tJjv} thus performs a trajectory in con- 
figuration space. Critical networks are of special interest 
[3. Their dynamics is at the boundary between a frozen 
phase where initially similar configurations converge, and 
a chaotic phase where initially similar configurations di- 
verge exponentially. 

However, synchronous update is highly improbable in 
real networks, and it is used under the tacit assumption 
that going to asynchronous update will not modify the 
essential properties of the system . But there are good 
reasons to doubt the validity of this assumption. For in- 
stance, for cellular automata it is well-known that some 
of the self-organization is an artifact of the central clock 
0. For RBNs there is also recent evidence that devia- 
tions from synchronous update modify considerably the 
attractors of the dynamics 0, 0| . 

In this paper, we investigate a version of the model 
where at each computational step one node is cho- 
sen at random and is updated. A model with this 
asynchronous stochastic updatin g sc heme is often called 
Asynchronous RBN ( ARBN) [ij, 111 , while the Clas- 
sical synchronous RBN is referred to as CRBN. ARBNs 
are mostly studied numericall y w ith the focus on various 
measures of stability [3, EHHE Ei- ARBNs were 
observed to be capable to generate an ordered behavior, 
but the detailed properties of attractors have not been 
studied yet. 

We will show mostly analytically that the number of 
attractors changes completely when going from CRBNs 
to ARBNs. For CRNBs, attractors are cycles in con- 



figuration space, and their number was recently shown 
numerically [UllliUllllill and analytically [HEi ] to 
grow faster than any power law with the network size N. 
In contrast, we will show in the following that for asyn- 
chronous stochastic update the mean number of attrac- 
tors grows as power law while their size increases like a 
stretched exponential with N. As the dynamics is no 
longer deterministic, an appropriate definition of an at- 
tractor must be given. An attractor is a subset of the 
configuration space such that for every pair of configu- 
rations on the attractor there exists a sequence of up- 
dates that leads from one configuration to the other. In 
, such an attractor is called "loose attractor" . Start- 
ing from a random initial configuration, the system will 
eventually end up on an attractor. 

Let us first consider a set of nodes arranged in a 
loop. Such loops occur as relevant components of criti- 
cal networks. Nontrivial dynamics occurs only if the two 
constant Boolean functions are omitted, the remaining 
Boolean functions being "copy" (0), and "invert" (0). A 
loop with n inversions can be mapped bijectively onto 
a loop with n — 2 inversions by replacing two with two 
and by inverting the state of all nodes between these 
two couplings. It is therefore sufficient to consider loops 
with zero inversions ( "even" loops) and loops with one in- 
version ( "odd" loops) . The position of the 0-coupling in 
the odd loop is called the twisted edge. For synchronous 
update, each configuration is on a cycle in configuration 
space and occurs again at most after N {2N) time steps 
for even (odd) loops. The number of cycles increases 
therefore exponentially with N. In contrast, most config- 
urations are transient in the asynchronous case, and only 
two (one) attractors are left. The reason for this is that 
a domain of neighboring nodes that have the same value 
increases or decreases with probability 1 /N per computa- 
tional step. The domain size therefore performs a random 
walk, and for an even loop no domain is left after of the 
order of updates. The attractors are the two fixed 
points. For an odd loop, the nodes of a domain change 
their state at the twisted edge, and the total number of 
domain walls is therefore odd. The attractor contains 
only one domain wall that moves around the loop, and 
the attractor comprises 2N configurations. The dynam- 
ics on such a loop is closely related to the Glauber dy- 
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namics [25j of a one-dimensional Ising chain with cycHc 
boundary condition at temperature T = 0, where the do- 
mains also shrink and grow with a fixed rate and where 
the equal-time correlation function obeys a scaling form 
C{r, t) = f{r^t^^) 26^- The dynamics of an odd loop can 
be mapped onto the dynamics of an Ising chain with one 
negative coupling. It is a frustrated system in which not 
all bonds can be satisfied simultaneously. To conclude, 
by going from synchronous to asynchronous update, the 
number of attractors of a loop is reduced from an expo- 
nentially large number to 1 or 2. This was also pointed 
out in [27| , where a different asynchronous updating rule 
is used. 

Let us next consider critical networks with connectivity 
k = 1, where the Boolean coupling functions are again 
"copy" and "invert". Relevant nodes are those nodes 
whose state is not constant and that control at least one 
relevant eleme nt l2ll| . They determine the attractors of 
the system. In '2^ , exact results for the topology of A: = 1 
networks are derived, and in it is shown that the 
number of attractors of a critical k = 1 network increases 
faster than any power law. The number of relevant nodes 
scales as \/N, and they are arranged in of the order of 
In(A^) loops. The remaining nodes sit on trees rooted 
in these loops. Under asynchronous update, each loop 
has at most two attractors. The nodes on trees rooted in 
even loops are frozen because the loop is on a fixed point. 
The nodes on trees rooted in odd loops can assume any 
combination of states, since one can find to each possible 
state of a tree a sequence of updates that generates it. 
Since each loop is even or odd with equal probability, the 
mean number of attractors of networks with n relevant 
loops is 

which is a power law in N. The number of nodes in trees 
is of the order of N. On average, half of the trees are 
rooted in odd loops. Consequently the mean attractor 
size increases exponentially with N. 

Finally, we investigate the most frequently studied crit- 
ical networks with connectivity k — 2, where each of 
the 16 possible Boolean coupling functions is chosen with 
equal probability. All nodes apart from the order of 7V^/^ 
nodes are frozen. This follows for instance from the fac- 
tor e"^ in the last term of Eqn. (9) of j2^ , which implies 
that only the fraction N^-^^^ of all nodes undergo a non- 
frozen sequence of states in time. Numerical support for 
this result is presented in [2(Tj |. 

The number of relevant nodes scales as N^^^ [S^l, and 
only a fraction N^^^^ of these relevant nodes have two 
relevant inputs. This last statement follows from the 
evaluation of Eqns. (6) and (9) in 23] in saddle-point 
approximation, where the width of the first term in the 
direction perpendicular to the line of maxima is of the or- 



der implying that of the order N ■ N'^/^ = iV^/^ 

nodes have 2 nonfrozen inputs. Consequently, the pro- 
portion iV^^/^ of nonfrozen nodes (whether they are 
relevant or not) have 2 nonfrozen inputs. This result, 
together with the other just mentioned features of the 
model is confirmed by (unpublished) studies of our group. 
The other relevant nodes have one relevant input (as the 
second input comes from a frozen node). The remain- 
ing non-frozen nodes (of the order of N^^^) are on trees 
rooted in relevant nodes. Just as for the k = 1 networks, 
there are of the order of ln(A'^) independent relevant com- 
ponents In contrast to the k = 1 networks, these 
components are not always simple loops, but may contain 
several nodes with two relevant inputs. In order to obtain 
results for the number of attractors of the networks, we 
have to investigate the attractors of such relevant com- 
ponents. 

Let us first consider relevant components that contain 
one node with two relevant inputs. These are two loops 
with one interconnection (O— O-component), and a loop 
with an extra link (0-component) . The dynamics un- 
der synchronous update for such components is studied 
in (291] ■ and it is found that the number of attractors in 
both systems increases exponentially with the number of 
nodes. With asynchronous update, the number of attrac- 
tors becomes very small. 

We discuss first two loops with one interconnection. 
The first loop is independent of the second loop, and its 
attractor is either a fixed point (if the loop is even), or 
it has one domain wall moving around the loop. If the 
first loop is on a fixed point, it provides a constant input 
to the second loop, which therefore behaves like an even 
loop, or an odd loop, or a frozen loop. The system can 
have at most three attractors. If the first loop is odd, if 
provides a changing input to the second loop, which can 
therefore have an attractor that contains an arbitrary 
and fiuctuating number of domain walls. Consequently, 
a loop that has one external input can show one out of 
four different types of behavior on an attractor: 

1. The loop can be at a fixed point 0. 

2. The loop can be at a fixed point 1. 

3. There is exactly one domain wall which moves 
around the loop. 

4. The number of domain walls in the loop fluctuates. 

(Without loss of generality, we have assumed that all 
coupling functions for nodes with one input are "copy" . ) 

Now we turn to a loop with an extra link. We can again 
assume that all coupling functions for nodes with one in- 
put are "copy" . If this component has one fixed point 
(two fixed points), it is (they are) the only attractor(s). 
This is because one can reach a fixed point from an arbi- 
trary initial state by updating one node after another by 
going around the loop in the direction of the links. After 
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at most two rounds the fixed point is reached. Only if 
the coupling function for the node with two inputs has no 
fixed point, a more complicated attractor occurs. With- 
out loss of generality, we choose this function to have the 
output 1 if and only if both inputs are 0. By considering 
the possible update sequences, one finds that the compo- 
nent can accumulate a large and fluctuating number of 
domain walls, as illustrated in Fig. ^ 




FIG. 1: A possible sequence of configurations of a loop with a 
cross-link showing how multiple domain walls are generated. 
The coupling function of the node O with two inputs is such 
that only two dark inputs lead to light output, all other com- 
bination give black output. After (e) the procedure described 
by (a) to (d) is repeated to obtain (f) and similarly for (g), 
(h) and (i). 

Equipped with these results, we now consider compo- 
nents with several nodes with 2 inputs. We define a sec- 
tion to be a sequence of nodes starting at a node with 
two inputs and ending right before a node with 2 inputs. 
Such a sequence can branch and have several end points. 
Clearly, the number of sections is the number of nodes 
with 2 inputs; a simple loop is counted as one section. 
A section is controlled by its first node, which is the one 
with 2 inputs. Just as for the loop with one external in- 
put, a section can show on an attractor one out of the 
four different types of behavior listed above. This is be- 
cause all states that have more than a single domain wall 
in a given section must be part of the same attractor. We 
show this by the following argument: Assume that on an 
attractor there occur two domain walls in a section. The 
two domain walls can be destroyed by updating all nodes 
between the two walls, such that the domain enclosed by 
the walls vanishes. A configuration with no wall on the 
section (and with the state of all other sections unmod- 
ified) is therefore also part of the attractor, and there 
exists consequently a way back to the configuration with 



two domain walls on this section. By repeating the same 
sequence of updates, every even number of domain walls 
can be created in this section, and odd numbers can be 
created by moving one domain wall out of the section. 
If s is the number of sections, an upper bound for the 
number of attractors of the component is therefore given 
by 4". 

We checked this analytical result by computer simula- 
tions. In order to make sure that we capture all attrac- 
tors, we did a complete search of state space, which can 
only be done for small networks. Starting from an ini- 
tial state, we did updates before assuming that the 
system is on an attractor, and we made sure that the re- 
sults are not changed when the length of the initial time 
period is varied. All states that can be reached from this 
last state are on the same attractor as this state. All 
other states that have been visited are marked as tran- 
sient states. Then we start with an unvisited state as 
new initial condition in order to identify further transient 
states and attractors. We constructed relevant compo- 
nents by starting with one loop of a certain size, and by 
iteratively inserting additional connections between two 
randomly chosen nodes. The new connection contains 
a randomly chosen number of 1 to 4 nodes (such that 
a section can contain two domain walls in its interior). 
In these networks, the number of sections, s, is identi- 
cal to the number of nodes with 2 inputs, ^. After each 
insertion, we evaluated the number of attractors for dif- 
ferent choices of coupling functions. This procedure was 
repeated more than 750000 times. The largest number 
of attractors found in a system is shown in Table as 
function of s = max(l, /i). 
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TABLE I: Maximum number of attractors //max as function 
of the number of nodes with 2 inputs, fi, for networks with 
up to 17 nodes. Networks with higher fj, are probed less often 
because if only short links are added there is no node left 
which has not already two inputs. 

This leads us to the conclusion that a network con- 
sisting of the order of In(A^) relevant components, with 
component number i having /i^ nodes with 2 inputs, can- 
not have more than 

jy _ ^max(l,/^i) ^ ^max(l,^i2) . . ^max(l,/ii„ iv)<^ ^ln{N)+fj. 

attractors. This is a power law in TV if the probability dis- 
tribution for the value of fj, becomes independent of for 
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large N. Indeed, as we have mentioned above, each of the 
N^^^ relevant nodes has two (randomly chosen) relevant 
inputs with probability aN~-^/^ (with some constant a). 
Since this probability is independent for different nodes, 
the value of fi is distributed for large N according to a 
Poisson distribution with a mean a. 

We thus have shown that in critical k — 2 networks 
with asynchronous stochastic update, the number of at- 
tractors grows as a power law in N, which is in strong 
contrast to the synchronous case, where the number of 
attractors increases like a stretched exponential function. 

We conclude with a discussion of the size of attractors 
in these networks. There are of the order of N"^^^ nodes 
on the trees rooted in the relevant components. These 
nodes in trees can adopt any configuration if the node 
they are rooted in can switch its state on an attractor. 
Since a non- vanishing fraction of all relevant nodes switch 
their states on an attractor, the size of the attractor is of 
the order of 

2^''' =exp(iV2/3ln2) . (3) 

The size of the attractors grows like a stretched exponen- 
tial function and therefore faster than any power law. 

Many of our results hold also for other kinds of stochas- 
tic asynchronous update, for instance if a certain (small) 
fraction of nodes is updated at each step, or if the time 
interval between two updates of a node is peaked at a 
value r and Gaussian distributed around it. (The lat- 
ter case describes our system for large N, when the net- 
work of relevant nodes is coarse-grained such that of the 
order of iV^/^ neighboring nodes are replaced by a sin- 
gle node that receives a delayed input from the previous 
node.) In these modified stochastic models, domain walls 
on an isolated loop can annihilate, but cannot be created 
again, leading to the same attractors as with the com- 
pletely stochastic update. However, the state of the trees 
rooted in the loops will be dominated by a few domain 
walls when the distribution of update times becomes nar- 
row, with states with more domain walls occurring rarely. 
Similarly, relevant loops that receive input from outside, 
and relevant components with nodes with two inputs will 
have attractors dominated by few domain walls, and the 
actual size of attractors becomes in the thermodynamic 
limit N oo smaller than the size obtained by consid- 
ering any possible sequence of updates. 

The biological implications of these findings are clear 
and have been pointed out in Since biological net- 
works do not have a completely synchronous update, the 
number of attractors should be derived from models with 
asynchronous update. In Q it is found numerically that 
the number of stable attractors increases sublinearly. At- 
tractors are called stable if they do not change when a 
perturbation is added to a synchronous updating rule. 
The present paper extends this finding by showing that 
the number of attractors in critical asynchronous Kauff- 



man models increases as a power law, and we thus regain 
the original claim by Kauffman - albeit for models with 
a different update rule than the original one. 

We thank V. Kaufman for useful discussions. 



[1] S. A. Kaufmann, J. Theo. Bio. 22, 437 (1969). 

[2] S. Kaufmann, Nature 224, 177 (1969). 

[3] J. M. Alexander, in Philosophy of Science Assoc. 18th 

Biennial Mtg (2002). 
[4] M. Paczuski, K. E. Bassler, and A. Corral, Phys. Rev. 

Let. 84, 3185 (2000). 
[5] S. Kauffman, C. Peterson, B. Samuelsson, and C. Troein, 

in Proceedings of the National Academy of Sciences USA 

(2003) , vol. 100, pp. 14796-14799. 

[6] M. Aldana-Gonzalez, S. Coppersmith, and L. P. 
Kadanoff, Perspectives and Problems in Nonlinear Sci- 
ence pp. 23-89 (2003). 
[7] I. Harvey and T. Bossomaier, in Fourth European Confer- 
ence on Artificial Life (ECAL97), edited by P. Husbands 
and I. Harvey (MIT Press, 1997), pp. 67-75. 
[8] T. E. Ingerson and R. L. Buvel, Phys. D 10, 59 (1984). 
[9] K. Klemm and S. Bornholdt (2004), cond-mat/0411102. 
[10] K. Klemm and S. Bornholdt (2003), q-bio/0309013. 
[11] C. Gershenson, in Artificial Life IX (MIT Press, 2004). 
[12] C. Gershenson, J. Jan Broekaert, and D. Aerts, in Ad- 
vances m Artificial Life, 7th European Conference ECAL 
2003, edited by W. Banzhaf, T. Christaller, P. Dittrich, 
J. T. Kim, and J. Ziegler (Springer, 2004), vol. 2801 of 
Lecture Notes in Artificial Intelligence, pp. 615-624. 
[13] C. Gershenson (2003), submitted to Phys. D. 
[14] E. A. Di Paolo, BioSystems 59, 185 (2001). 
[15] P. Rohlfshagen and E. A. Di Paolo, BioSystems 73, 141 

(2004) . 

[16] J. Hallinan and J. Wiles, in Ninth International Confer- 
ence on the Simulation and Synthesis of Living Systems 
(ALife9) (2004). 

[17] B. Mesot and C. Teuscher, in Advances in Artificial Life. 
Proceedings of the 7*'' European Conference, ECAL2003, 
edited by W. Banzhaf, T. Christaller, P. Dittrich, K. J. 
T., and J. Ziegler (Springer- Verlag, Berlin, Heidelberg, 
2003), vol. 2801 of Lecture Notes in Artificial Intelligence, 
pp. 367-376. 

[18] M. T. Matache and J. Heidel (2004), submitted to Phys. 
Rev. E. 

[19] S. Bilke and F. Sjunnesson, Phys. Rev. E 65, 016129 

(2002) . 

[20] J. E. S. Socolar and S. A. Kauffman, Phys. Rev. Let. 90, 

068702 (2003). 
[21] U. BastoUa and G. Parisi, Phys. D 115, 219 (1998). 
[22] U. BastoUa and G. Parisi, Phys. D 115, 203 (1998). 
[23] B. Samuelsson and C. Troein, Phys. Rev. Let. 90, 098701 

(2003) . 

[24] B. Drossel, T. Mihaljev, and F. Greil (2004), cond- 

mat/0410579. 
[25] R. J. Glauber, J. Math. Phys. 4, 294 (1963). 
[26] A. J. Bray, J. Phys. A 23, L67 (1990). 
[27] K. Klemm and S. Bornholdt (2004), q-bio/0409022. 
[28] H. Flyvbjerg and N. J. Kjaer, J. Phys. A 21, 1695 (1988). 
[29] V. Kaufman and B. Drossel (2004), cond-mat/0410546. 



